Non-Markovian Processes with the Semigroup Property
نویسندگان
چکیده
منابع مشابه
Simulating non-Markovian stochastic processes.
We present a simple and general framework to simulate statistically correct realizations of a system of non-Markovian discrete stochastic processes. We give the exact analytical solution and a practical and efficient algorithm like the Gillespie algorithm for Markovian processes, with the difference being that now the occurrence rates of the events depend on the time elapsed since the event las...
متن کاملExploiting non-Markovian Bio-Processes
The Stochastic Simulation Algorithm (SSA) is a milestone in the realm of stochastic modeling of biological systems, as it inspires all the current algorithms for stochastic simulation. Essentially, the SSA shows that under certain hypothesis the time to the next occurrence of a biochemical reaction is a random variable following a negative exponential distribution. Unfortunately, the hypothesis...
متن کاملOn Binary Quadratic Forms with Semigroup Property
A quadratic form f is said to have semigroup property if its values at points of the integer lattice form a semigroup under multiplication. A problem of V. Arnold is to describe all binary integer quadratic forms with semigroup property. If there is an integer bilinear map s such that f(s(x,y)) = f(x)f(y) for all vectors x and y from the integer 2-dimensional lattice, then the form f has semigr...
متن کاملBayesian Inference for Non-Markovian Point Processes
Statistical inference for point processes originates, as pointed out by Daley and Vere-Jones (2005), in two sources: life tables, and counting phenomena. Among early sources of inferential work are Graunt, Halley and Newton in the 18th century on the life table side, and Newcomb, Abbé and Seidel in the second half of the 19th century on the counting side (for Newcomb’s contributions, see Guttor...
متن کاملNon-Deterministic Policies In Markovian Processes
Markovian processes have long been used to model stochastic environments. Reinforcement learning has emerged as a framework to solve sequential planning and decision making problems in such environments. In recent years, attempts were made to apply methods from reinforcement learning to construct adaptive treatment strategies, where a sequence of individualized treatments is learned from clinic...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
ژورنال
عنوان ژورنال: The Annals of Mathematical Statistics
سال: 1959
ISSN: 0003-4851
DOI: 10.1214/aoms/1177706110